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Abstract. We consider the question of entropic uncertainty relations for prime power dimensions. In 
order to improve upon such uncertainty relations for higher dimensional quantum systems, we derive 
a tight lower bound amount of entropy for multiple probability distributions under the constraint that 
the sum of the collision probabilities for all distributions is fixed. This is purely a classical information 
theoretical result, however using an interesting result by Larsen [Lar90j allows us to connect this to an 



entropic uncertainty relation. 

Oh 
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C/^ 1 Preliminaries 

O 

^ 1.1 Mutually Unbiased Bases 

Let |0) and |1) be the basis vectors for tlie computational basis. Then we can define the three 
^ mutually unbiased bases as 

I 5S, = {|0)+,|1)}+ = {|0),|1)} 

a; 53, = {|0)x, |l)}x = {^(|0) + |1)), -^(|0) - |1))} 

^ = {\oh,\i)h = {^m + -^m - iim 

^C!^ often referred to as the computational, diagonal and circular-basis, respectively, where only the 

\^ first two was used in BB84. Recall that they had the interesting property that if you measured in 
the "wrong" basis, you'd destroy all information and gain none. This property is still true if you 

<^ include third basis and can in fact be generalized. When a set of bases has this property they are 

^ called mutually unbiased, or MUBs. 

^ Definition 1. A pair of orthonormal bases A = \ ao),-..,| fld-i) CL'iT'd B = \ 6o),---,| id-i) for a 

^ d- dimensional complex Hilhert space are said to he unbiased iff for any basis vector \ Cj) and \ bj) 



I bj)\ 



2 = 1 

d 



In the case where A and B are observables for a quantum system measuring observable A will, 
independently of the outcome, leave the state of the system in a uniform superposition of all the 
basis vectors of B. 

Definition 2. A set of M orthonormal bases {Aq, Am-i} , for a d dimensional Hilbert space, 
are said to be mutually unbiased if, and only if, for any i,j G [0,...,M — 1], where i ^ j, Ai and 
Aj are unbiased. 



Number of MUBs in dimension d The number of possible MUBs for a d-dimensional complex 
Hilbert space in general is an open research problem. Some of the most important results that are 
know will be covered in this section. For |Eng03| . 

For a d-dimensional complex Hilbert space, let ^MU denote the number of possible MUBs and 
let 

d = pfi X ...xpf' 

be the prime decomposition of d such that p^'^ < ... < pj^' ■ 
Fact 1 

#MUBd > + 1 (1) 

Fact 2 

#MUBd <d+l 



Note that this means that is tight when d is a prime power (i.e. d = Pi^). In this case explicit 
constructions are also known jBenOGj . 

As an example, take d = 6. By ([l]) there must be at least 3 MUB^ These have indeed been found 
but it is an open question as to which there are more. If any additional exists it seems unlikely they 
would not have been discovered after considerable numerical effort [BH07j but as it stands no one 
knows. 



Know^n relations for Shannon entropy Maassen and Uffink |MU88] proved the following en- 
tropic uncertainty relation for the special case of 2 bases, A and B 

H{A) + H{B) > -21n(c) 

where c = maxij{\{ai \ bj)\). When A and B are unbiased we have that the relation reaches its 
maximum value, 

c = maxij{\{ai \ bj)\) = 

\J d 

As discussed above, when d is a prime power the number of mutually unbiased bases is d + 1. 
When using M < d + 1 of those MUBs it has been shown in |Aza04j |San95| and independently 
in |WYM09] that the following entropic uncertainty relation holds. 



Lemma 1. Let ...,Am he M < d+1 mutually unbiased observables for a d- dimensional quan- 
tum system, where d is a prime power. Then 



M 



XI H{Am) > M X ( ln(«;M) - {kM - 1) x [ kM x ^ ^ , - 1 ) x In 



m=l 

where 



dx M 



kM 
kM - 1 



d 



d + M-1 



^ This is in fact true for all dimensions 



2 



The above relation was proven to be tight for d = 3, M = 4 in |San94| but it is not tight in general. 
It is based on the following interesting result By Larsen jLar90| 



Lemma 2. Given any quantum state p £ V{'Hd), where d is a prime power, let Am be the m'th 
mutually unbiased basis. Then 

d+l 

IC{Am) = Tr{p^) + 1 



m=l 

^2^ 



And since Tr{p ) < 1 (equality when p is a pure state) we have 

d+l 



5^ IC{Am) < 2 



m=l 



Since we can lower bound the collision probability for the distribution of any random variable over 
d outcomes by ^ we get that 



Corollary 1. 



IC{Am) <2-^x(d-M + l)= "^^^ ^ 

m=l 



This bound is generally not tight. 

In this light Lemma [T] can be viewed as a combination of two relations. The first is Corollary [l] 
while the second is the following result that is a classical relation between collision probability and 
the Shannon entropy |HT01j . 



Lemma 3. Let {Xi, ...,Xm} be a set of M discrete random variables all over a finite set of d 
values. Let {Pxd -Pxjv/} corresponding probability distributions where 



M 



Y^C{Px^<hot 



i=l 



then 



where 



M 



1=1 



Y ^(^i) > M X I In(KM) - {kM -1) X (kM X '-^ -1] X In 



hot 



kM 



kM-I 



(2) 



tot 



This bound is generally not tight. For most values of collision probability for a distribution the 
Shannon entropy has a range of possible values. It is hence impossible to turn Q into an equality 
for all values. It is, however, possible to give a tighter bound. This problem will be the main topic 
of Section 11.31 
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1.2 Higher order entropic uncertainty relations 

While entropic uncertainty relations for the Shannon entropy are interesting from a purely theo- 
retical viewpoint and sometimes useful, it is often necessary to use higher order entropy such as 
collision entropy (a = 2) or min-entropy {a = oo) (eg. privacy amplification). Unfortunately a 
lower bound on the Shannon entropy does not directly imply a lower bound on a > 1. 
Using the convexity of — ln{k) and Corollary [l] a simple lower bound on the collision entropy can 
be constructed (see also |San95] ). 

Lemma 4. Let Ai, ...,Am be M < d+1 mutually unbiased observables for a d dimensional quantum 
system, where d is a prime power. Then 

m=l ^ ^ 

A particularly interesting result jDFR"'"06] relates the Shannon entropy to the min-entropy. 
Assume you have a quantum state pE that is comprised of n individual d-dimensional quantum 
states, pi,...,pn. Each state is encoded in some basis chosen randomly and independently from a 
known set of bases. This could be a string of n qubits as in BB84-coding. Let /i be a lower bound on 
the average Shannon entropy on the probability distributions of each state, then the min-entropy 
for the probability distribution from measuring p^; is lower bounded by ~ nh. For the full formal 
description see the original article. The important thing to note is that improved relations for the 
Shannon entropy on a d-dimensional quantum state can be used to improve min-entropy relations 
for a register of n such states. An example where this is applicable is [DFSSOT] . 

1.3 Probability and Shannon Entropy Relations 

Let X be a discrete random variable over a finite set, X, d values. Let Px be the corresponding 
discrete probability distribution. Assume you know an upper bound, Px < k, on the collision 
probability for the distribution and know a lower bound, Pmin, on the probability for any element 
in X. I.e. Vxj G X : Px{xi) > Pmin- In this situation you might be interested in a lower bound on 
the Shannon entropy for Px- While |HT01| has given a tight answer for the case where Pmin = 0, 
to the best of our knowledge, there is no tight bound for the slightly more general case of > 0. 
Section [2] will show a tight bound for the general case. Also, it is our opinion that the proof is 
simpler than the one presented in [HTOlj . 

Now consider instead a situation where you have a set of M discrete random variables {Xi, ...,Xm} 
where Xi is over a finite set of di values. Let {Px^^, Pxm} be the corresponding probability 

M 

distributions. Assume you know an upper bound, ^^/C(PxJ < hot, on the sum of collision 

probabilities for the distributions. Similarly to above, you might want a lower bound on the sum of 
Shannon entropies for the distributions. To the best of our knowledge. Lemma [3] is the best known 
lower bound. An improved and proven tight bound is given in section [3j 

2 A single probability distribution 

Lemma 5. Let X be a discrete random variable over a finite set, X , of d values. Let Px be the 
corresponding discrete probability distribution where Vxj G X : Px{xi) > Pmin 

and IC{Px) < k. 
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Then 



H{Px) > H{P'x) 

Pmin < P'xixi) < P'x{x2) < ■■■ < Pxi^d) 

IC{P'x) < k 



where P'x is defined as 



P'xixi) = P'x{x2) = ••• = P'x{xd~H~l) = Pmin (3) 
P^{Xd-Si) = l-PminX {d-A-1) ^ (4) 

Px{xd-si+i) = ■■■ = Pxixd) = WTJ 



A = y^Six{k + Kxk-l+ Pmin X (d X Pmin + 2d + K X d X Pmin - d"^ X Pmin -2^-2)) 



d> a 



{I — d X p. 



\2 



mm J 



d X Pmin - 2 X Prnin + 



>1 (6) 



Proof. This will be proven by explicitly constructing the probability distribution P^ and show it 
is the (real) solution to the following minimization problem 

minimize H{Px) subject to 
ICiP'x) < k 

P'min < P'xi^l) < P'xi^2) < - < P'xi^d) 



It is straight-forward to see that we can assume Q to reach equality for the solution. We also need 



the following Lemma, the proof of which can be found in Section 2.1 



Lemma 6. Given three probabilities P^ixi) < P^ixj) < P^(xfc) that are part of the solution to 
^ and where 

e = P'x{x,) + P'x{x,) + P'x{xk) 
k' = P'xix.f + P'xixjf + P'xixkf 

If P'xixi) > Pmin then it must be that 

Px{xj) = Pxixk) = 2 + ^ 

Proof. For readability we will in the following for all i write P^(xi) = pi. 
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Proof of ([3]) This will be shown by contradiction. Assume Pd-sio be the first probability greater 
than pmin and that > Then define 

yj,l:d-Sio<j<l<d 
1 2 I 2 ( 2 

e = Pd-Sio + Pj + Pi 

Since the entire entropy function is minimized, the entropy of these three probabilities are also 
minimized according to lemma 2, given e and k. Which means we can assume that the entropy 
contributed by these three probabilities are decreasing in k. We can therefore assume that constraint 
24 is an equality. Since Pd-no > Pmin then by (21) in Lemma [6| we see that pj = pi. This implies 



that pd-^+i = ... = Pd = % ^P^^ ^ (•'^o 1) ^ rpj^g collision probability of the entire distribution 
can hence be given as a function of ^ 

k = pLin X (d - J^o - 1) + pLj^o + Pd-^o+i + -+pI 

= ( 1 X (-'^0) + Pd-Ro + Pmin X (d - i^O - 1) 

Solving this for ^ gives 

^ _ {Pd-Sio - Pmin + dpmin - 1)^ 

k — 2pmin + d X p^in — Pd-iig ~ Pmin + '^Pd-iio X Pmin 

And by assumption we have that 



(Pd-.So - Pmin + dp 

mm ^ 



i2 



{1 — d X p. 



"^Pmin + d X p^in Pd-Hn Pmin + '^Pd-^o X Pmin 



> 



mm ) 



^ X Pmin ^ X Pmin + k 



{Pd—J^O Pmin + dpmin 1)^ (\ d X Pmin)"^ 



> 



k - 2pmin + dx - pI_^^ - + 2pd-ii, X p^in d X - 2 X Pmin + k 



Where the last inequality follows from that ^ must be integer. 
Take the derivative of the left hand side with respect to Pd-sio 



d {Pd—^o ~ Pmin + dpmin ~ 1)^ 

dpa-Kg k - 2pmin + dx - pj_^^ - + 2pd-i^o X Pmin 

_ r, (Pd-Ho - Pmin + D X Pmin - l){k - Pd-Ao ~ Pmin + dx Pd-Sio X Pmin) 
- 2pmin + DX - _ pI^.^ + 2pd-Ao X Pmi^ 

Note that the denominator is always positive. Looking at the numerator, see that (pd-^j, — Pmin + 
D X Pmin — 1) < except for Pd~sio + (-D — 1) x pmin > 1, which is impossible for a normalized 
distribution. 
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Also note that [k-pd-^^^-pmin + dy^Pd-Ao XPmin) > except for k < Pd-Ao+Vmin-dxpd-^i^ XPmin- 

However this would imply that 



k < Vd-Ro + Pmin — d X Pd^iiQ X Pr 

fl-pd-Sio-PminX{d-^-l)Y , . 2 , 2 ^ / , « .^ 

( 1 X i^) + Pd-Ho + Pmin X (d - - 1) 

< Pd-Sio + Pmin - dx Pd-i^o X Pmin 
(d X Pmin - l)ipd-.tio - Pmin + dx Pmin - 1) < 

Which is impossible because 

{d X Pmin - 1) < 
{Pd-no - Pmin +dx Pmin - 1) < 

Hence ^ < which means that the function should each its maximum when Pd-sio approaches 
Pmin- Therefore 

{Pmin Pmin ~\~ d X Pmin 1 ) 
k — 2pmin + d X Pmin ~ Pmin ~ Pmin + "^Pmin X Pn 



[1 — d X p 



'min 

'min ) 



d X Pmin - 2 X Pmin + k 

> 

_ {Pd-.tio - Pmin + dx Pmin - 1)^ 

k - 2pmin + dp"^-^ - pI_^ + 2pd-SioPmin 
> ^ 



[1-dx pmir 



d X Pmin - 2 X Pmin + k 

Which is a contradiction and completes the proof. 
Proof of ([ij) + (js]) Assume that Pd-A = Pmin- Then 



k>(d-M)x rl,, + ^'^^'-- ^ ' X (7) 



Si 

Solving this for ^ 

{l-dx Pminf 



d X Pmin - 2 X Pmin + k 

Comparing with Equation (|6]) this must be an equality which means Equation ([T]) must also be an 
equality. This is only possible when 

Pd-^+i = -■■=Pd 
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When Pd-^ > Pmini we can use (21) in Lemma [g] to show that 

Pd-Si+l = ...=Pd 
Putting the two together means we can say that 

1 = (d - - 1) X pmin + Pd-Sk + ^X- Pd 

Pd-n = l-(d-i?-l)x Pmin - ^iy-Pd (8) 
k = {d- ^-l)xpl^i^+pl_^ + Axpl 

= {d- a-l) X + (1 - (d - - 1) X Pmin Pdf + ^^pI 

Solving this for pd and using that pd > Pd~si we get that 

_ i^X {1+Pmin X (J^+l-d)) + Z\ 
A = y/iix{k + Kxk-l+ Pmin X (d X Pmin + 2d + K X d X Pmin - X Pmin - 2J^ - 2)) 

which together with equation |8] completes the proof. 

□ 

For later reference we define the function H{k,pmin) which is the lower bound on the Shannon 
entropy given the collision probability, k, and the smallest probability, Pmin- 

H{k,Pmin)=H{P'j,) 

= -Pmin X In(pmm) X {d - Si - I) (9) 

- Px{xd-ii) X \n{P^{xd-si)) - P'xixd) X HP'x{xd)) x R (10) 

In the special case of Pmin = the result reduces to a result found in [HT01| . In this case P'x 
simplifies to 



Corollary 2. 



P'xixi) = P'xix2) = ... = P'xixd-n-i) = (11) 



, j^+y/j^X (fc + J^xfc)-l 
Pxixd-Si+l) = ... = PxiXd) = ^2^^ 



(13) 



d> Si 



> 1 



For later reference we define the function H(k) which is the lower bound on the Shannon entropy 
given the collision probability, k. 

H{k) = H{P'x) 

= -P'xixd^a) X MP'xixd-ii)) - P'xixd) X HP'x{xd)) X Si (14) 
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The shape of H(k) consists of a set of singularities at each point where 



1 

k' 



This is the points where R changes value and all three functions are equal in these points, which is 
when the distribution is uniform. The distance between the points increase as k approaches 1. In 
the other end, as A: — )• all three functions goes to infinity. 

Sometimes it is useful to look at H{k) while keeping K constant. In this case we consider the arc 
between two singularities. Restricted to these areas the function is smooth and hence differentiable. 
It is shown in |,HT01j that H{k) on these arcs is concave which will be important. 

2.1 Proof of Lemma [6] 

First we will show slightly different result and then rewrite Lemma [6] Given three probabilities 
Pi ^ P2 ^ P3 where 

e = Pi+P2+P3 (15) 
k = pl+pl+pl (16) 

we can express p2 and using pi , e and k 

e = Pi+P2+P3 (17) 
k=pl+pl + ie-pi-p2f (18) 



P2{pi,e,k) = I - y - '^ 
P3{pi,e,k) = \-^+^ 



A/2e X pi - e2 - 2,p{ + 2k 
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Since 5 has to be real we have that 5 > and because pi < p2 we get 

0<6<'-^ (19) 

Let H{p) = —p X ln{p) be the Shannon entropy function, we can then express the sum of entropies 
for the three probabihties function of pi , e and k. 

H'ipi,e, k) = Hipi) + Hip2{pi,e, k)) + H{p^{p^,e, k)) 



Lemma 7. Let pi, e and k be defined as above, then 

dH^{pi,e,k) 
dpi 



> 



In other words, if e and k are kept constant, the entropy function wiU be at its minimum when pi 
is at its minimum. 

Proof. Taking the partial derivative of with respect to pi gives 
dH%pi,e,k) 



dpi 



ln{p 



For any particular value of pi, S can have any value between and ^— Below we'll show that 
(20) reaches its minimum value for a constant pi when 6 = ^— This will be done by dividing 
the function into three parts and show that each part is non-increasing in 6 (for a constant pi and e). 

Part 1 : —ln{pi) 

This function is trivially non-increasing in 5 

Part 2: i) x (Zn (5 - f + |) - /n (-5 - ^ + f )) 

Define « = f — ^ and notice that ^^^g"^*^ is a negative constant factor. 

X {In {a + 5) — In (a — 5)) 

This can be rewritten using a Taylor series, 

1\ oo . 2j2n \ 

-^)^{ln{a + 5)-ln{a-5)) = - g [j^^^^^y^i ) 

Because a > the above function is non-increasing in 5. 



10 



Part 5 ; f X (/n (5 - f + f ) + (-5 - f + f )) 

Similar to before, define o, = ^ ~ ^ and notice that | is a positive constant factor. 

In {a + 6) + In (a — 6) 
This can be rewritten using a Taylor series, 

ln(a + 6) + ln{a -6) = 2ln{a) - J] i ^-^^ j 

n=l ^ ^ 

Because a > the above function is non- increasing in 6. 



This can be used to finish the proof of the lemma Because 5 < e — 2>pi 
dH\pi,e,k) 



dpi 



ln{p 



1) 

> -ln{pi) 

_ {ln{e - 2pi) + ln{pi)) x (e - 1) 
2 

We have that (e - 1) < and ln{e - 2pi) + ln{pi) < 

dH^{pue,k) ^ (ln{e-2pi) + ln{pi)) x (e - 1) ^ 
dpi - 2 

which completes the proof of Lemma [7] 

We can now restate Lemma [H 

The solution to the minimzation problem 

minimize H"^{pi,e,k) subject to 

k = pl+pl+pl 
e = pi+p2+P3 



IS 



P2=P3 = ^ + 



e VQk - 2e2 



6 
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Proof. By equation 19 we have that 



0<6 



A/2e X pi - e2 - Spj + 2k 



By solving for pi and using that pi < p2 we get 

e VQk - 2e2 

«i > 

^ 3 3 

Since by Lemma [7] the entropy is non-decreasing in pi we can assume that the entropy is minimized 
when it is at its smahest value. Since pi > Pmin it must be that pi = | — ^^^"^'^^ which in turn 
means that (5 = 0. Putting it together we have that 

e y/Qk - 2e2 



Pi 

P2{pi,e,k) 

P3{pi,e,k) 
which completes the proof. 



3 3 
e _ Pi 
2 2 
£ _ Pi 
2 2 



-(5 
+ <5 



Pi 
2 
Pi 
2 



e - 2e2 

3 6 



e VQk - 2e2 
3 6 



□ 



3 Multiple probability distributions 

We now consider the case of a multiple of distributions. 

Lemma 8. Let {Xi, Xm} be a set of M discrete random variables each over a finite set of di 

M 

values. Let {Px^, Pxm^ be the corresponding probability distributions where IC{Pxi) — ^tot- 

i=l 

Assuming that 

1 1 

(22) 



then it holds that 



where 



\/i = 1,...,M : — < 
di 



M 
ktot 



M 



M 



i=l i=l 
M 

Y,IC{P'xJ<k, 



Hot 



i=l 



M 



Y,H{PxJ = ^H{k^,n) + (M - 1 - <P)H{kmaa 
+ H{ktot - 'L'hnin -{M -l-<P)kr^ 



i=l 



(23) 
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and 



hot - M X kr, 
kmin km,a: 



M 
ktot 



M 
ktot 



Proof. This will be proven by explicitly constructing the M distributions, {Px-^ , Pxm} ^^"^ show- 
ing they are the (real) solution to the following minimization problem 



M 



minimize H{P'x.) subject to 

M 

Y,ic{p'x:)<ktot 



(24) 



i=l 



Let ki = IC{P'j^,). Because H{ki) is the smallest Shannon entropy given ki we can assume that 
H{P'x) = H{ki) And because H{ki) is decreasing in ki it must be that (24) achieves equality. We 
can now restate the problem slightly. 



M 



1=1 



minimize ^^^(/cj) subject to 

M 

^ ^ ki = kfot 



(25) 
(26) 



i=l 



By concavity of H{k) for constant K and linearity of (26) we can, without loss of generality, assume 

M 



that the smallest value of H{Px.) is found wher 



1=1 



Vi = 1...M- 1 



1 

ki 



(27) 



Here ku is not included because we are constrained by (26). 



This gives a finite number of possible solutions but it is not a priori clear which exact values each 
ki should take. However, note that ^^j^ is the average collision probability for each distribution and 
if we ignore the local concave structure of H{k) the overall shape of it is actually convex as can 
be seen from figure [2| This is most easily seen by realizing that — ln(A;) is convex. Since each ki 
is linearly dependent of the others you would, loosely speaking, expect the Shannon entropy to be 
minimized when all the values are in the same " area" of the grapl:[^ This is in fact true and to 



^ For more information on convex/concave optimization see |Boy08| 

^ li H was completely convex then, by Jensen's inequality, the Shannon entropy would be minimized they're all in 
the same point. That is, when ki = ... = kM = ^ff*- 
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prove it we will need two Lemmas. The proofs are surprisingly involved and is postponed to Section 
Assume we have two values 1 > /c2 > > such that 

and 

1 

> ki. 

i^2 + l 

The intuition is that ki is to the left, and on a different arc than k2 in figure [2] 
Define 

£2 = k2 



J^2 + l 

I IT " ^1 else 
Lemma 9. //ei > 62 i/ien 

#(A:i) + H{k2) > H{ki + £2) + H{k2 - €2) 

Lemma 10. // ei < €2 then 

H{ki) + #(A;2) > H{ki + ei) + i7(A:2 - ei) 

Note that it follows from the definition that both ei and 62 are strictly positive. To understand 
these results, take two different arcs on the graph in Figure [2] Lemma [9] says that if you place the 
top endpoint of each arc on top of each other, the arc to the left (^2) will always stay helow the 



arc to the right {ki). Similarly, Lemma 10 says the if you place the bottom endpoints of each arc 
on top of each other, the arc to the left (^2) will always stay above the arc to the right {ki). 
These two Lemmas will now be used to prove two claims. The first of which is 



Claim. 

1 

M 



Vi = 1...M : ki > r ^ -I = krmn 



ktot 

That is, none of the /cj's in a solution can be on an arc that is below the arc the average value 
would be on. 

Proof. This will be shown by contradiction. Assume there that is part of 



a solution to (|25l). Then, because kmin < tt^j there must be some value ki > k 



Let 
and 



ei and £2 are the distances to the next singularity when moving fci to the right and k2 to the left, respectively 
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We have that 



which means 



> T > i^z 

"'mm 



1 



We can now apply either Lemma [9] or Lemma 10 In each case it is possible to construct two values 
k'j = kj + e and k[ = ki — e such that 



and 



kj ~\~ ki — kj -\- k^ 



H{kj) + H{ki) > H{k'j) + H{k'i) 



which means kj cannot be part of a solution to (25). This is a contradiction and completes the proof. 



□ 



Claim. 



Vi = 1...M : ki<k 



M 



That is, none of the fcj's in a solution can be on an arc that is above the arc the average value 
would be on. 

Proof. This will also be shown by contradiction and follows the same line as the proof for the first 
claim. Assume there is some value kj > k^ax that is part of a solution to (25). Then, because 
kmax > ^f^, there must be some value ki < kmax- 



Let 



^3 = [ 



1 



and 



We have that 



which means that 



^ kmax ^ kj. 



iij + l 



We can now apply either Lemma [9] or Lemma 10 In each case it is possible to construct two values 



Jxij — kj c 



and 



k'l = ki + e 
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such that 



and 



kj ~\- ki — kj -\- k^ 



H{kj) + H{ki) > Hik'A + H{k'i) 



which means kj cannot be part of a solution to (25). This is a contradiction and completes the proof. 



□ 

Combining Claim [3] and [3] gives that all the /cj's in a solution must be on the same arc. That is, the 
arc where the average value, ^J^, would be. Also, we already have from (27) that all values, except 
one, should be in a singularity. Putting it together, we get that 

Vi : 1...M — 1 : k^ G {kmim kmax} 

Finally, to figure out which exact value they should take we define <^ and M — I — ^ as \{i £ 
[0,...,M-1] : ki = kmin}\ and \{i £ [0,...,M-1] : ki = 

^maxll respectively. In other words, ^ is the 
number of probability distributions P'^ that have collision probability kmin- From this it follows 
that 



kmin < hot - '^kmin - {M - 1 - <P)k„ 

To find the value for ^ such that the above constraint is satisfied we simply solve for it. 



tot 



M X k„ 



h ■ — k 

"'mm "'max 



^ has to be an integer which means 

^ktot - M X k 



kn 



1< ^ < 



k 



tot 



M xkr, 



k 

"'Tl 



k 



ktot - M xk 



kmin kj-^ 
ktot- M xkr, 



The left and right-hand side side are equal, except when — ^ """"^ is integer. Below we will see 
that choosing either left or right actually results in the same solution with a slight change of labels. 

/ where I is some integer, then 



Assume that ^^^""^ 



We also have that 



Combining the two gives 



Hot 



ktot — (iV/ I^k^nax ~l~ I kmin 
= ^kmin + {M-l-<P)k 

max + ku 

= (1 + ^ 



+ {I-<P)kmin 

kmin and = I (right inequality) will make 



/cm = (1 + ^ - I)kmc 

Choosing = / — 1 (left inequality) will make fcjvf 
kM = kmax- Both choiccs therefore result in the same solution. The only difference is /cm swapping 
labels with another ki. 
So after aesthetic considerations we choose 

^ ktot ~ M X kmax 



This completes the proof of Lemma [8j 
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□ 

Notice that the M probabihty distributions {-P^^, -fx a/} exphcitly given a colHsion probabil- 
ity. Using Lemma [2] is it hence possible to construct the distributions. That is, every outcome in 
every distribution is given a specific probability. It therefore follows that the bound is tight. 



3.1 Proofs of Lemma [9] and 1101 
Lemma [9] If ei > 62 then 

Hiki) + H{k2) > H{h + £2) + H{k2 - €2) 
Proof. Since H(ki) is decreasing and concave between .^i + 1 < ^ < ^1 



H{ki)- H{ki + e2) > Hi- 



Hi 



+ 62 



Using that €2 = k2 — ^^TT '^^^ restate the problem in a slightly different way 



Hi 



1 



^2 / Q „ 



Hi^r^ + e2)>Hi ^ 



^i^i + 1 







1 



+ e ]de> 



i?2 + l 

^2 / Q 



Hi 



1 







de 



H 



'Si2 + l 
1 



+ 62 



(28) 



i^2 + l 



+ e 



de 



First look at the derivative of -ff + e) with respect to e when 
guaranteed to be by the definition 



ti+e 



^ is constant, which it is 



In 



2 X 



A, 



e(j^+l) 



Therefore Aj^ is a strictly positive and decreasing function with for e > 0. That is Aj^ > and 
Take the derivative of 



d_ 



with respect to 

ei^+l)i2R+2^Aii-l) 
~ ~ 2Si (2e + eZ\^ + J^Z\^ + 2eii + eUA^i 



(29) 



Since 2^ > 1 we see that 29 is strictly negative function for e > 0. By monotonicity of the logarithm 
this means J^/n (^-^§^^Pj < for e > 0. 

From IHTOl) we know that ^Hi^ + e) < which implies that In 
Putting this together gives that 



< for e > 0. 
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for e > 0. This specifically means thalj^ 



for e > 0. Finally using that 62 > we get that 



which completes the proof. 



Lemma |10| If ei < £2 then 

Hih) + H{k2) > H{ki + ei) + H{k2 - ei) 
Proof. Note that since H{k2) is decreasing and concave for j^2 + 1 < ^ < i?2 

H{k2 - ei) - H{k2) < - ei) - H{^) 

Define i^'i = j^i - 1 if = j^i otherwise ^1= ^i. Also note that H{\) = ln{^i). 
Using this we can restate the problem 

- ei) - ln{^2) < - e,) - ln{ii[) 

A2 A 1 



By defining Sj^(e) = ^xy^ — — ewe can rewrite — e) as 

In (-^) {s^{e) - 1) In (^^) (s^ie) + 



□ 



^ Both derivatives are negative, so the statement is basically that the slope is more sharply decreasing for 
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Define 



^(e) = H{- - 6) - ln{ii) 




Fig. 2. Full line: /2(e). Dashed line: /3(e). 



Using Sj^(e) = ^ x \J ^ ~ %~ ^ we can define tlie inverse function for < s < 1 

1 

Note that e^(s) > e^+i(s) except for s = 1. 

For each two points /j?(ej^) and /ft+i(e^+i) where s^(e£) = s^+i(ej^+i) = s, let dL(s) be the 
derivative of the line between them. 



dL{s) 



In 



^+1 ^+1 



(i^+l) + l 



Define df{s) as the derivative of /j?(e) as a function of s, such that s = sj^(e) 



In 



t 

2s 
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Define 7(5) to be the difference between the two derivatives 



^ X In 

7(s) = dfis) - dL{s) = 



2s ej^(s) - e^+i(s) 

Below it will be shown that 7(5) is a strictly negative function for all s. This will imply that 
for all values of ei > there exists a line between the point to a point {£2, /j?+i(e2)} 

such that ei > €2 and the derivative of the line is less negative the derivative of /i?(ei). Since is 
concave this in turn implies that will never pass through the point {€2, fsi+i{e2)}- Since this is 
true for all ei > we can conclude that the two lines never cross. In other words theres exists no 
e such that faie) > /(^+i(e) except for e = where they are equal. By simple induction this shows 
that for any ^'1 > ^2 

- ei) - ln{ii2) < - ei) - /n(J^'i) 

Jt2 •ft 1 

for ei > which will complete the proof. 

It therefore remains to show that 7(5) is a strictly positive. This will be done by proving that the 
slightly different function 7(5) is strictly positive. 



7(s) = -7(5) X (e^(s) - e^+i(s)) 

= /j^(eii(s)) - /j,+i(e^+i(s)) + — ^ X (eji(s) - eji+i(s)) 

This is allowed because esi{s) — e^+i(s) is a strictly negative function. 



i'{s) = - 
+ 



.s3(s - 1) (i^ + S)2 (J^2 + + 2) (J^ + s + 1) 

X s - Siis"^ - iis^ + 7Six + 2iix s - Ss'' + 2^^ + Ss^ 



s3(s- l)(j^ + s)2(^2 + 3_^ + 2) i^+s + l) 



s3(s - l)(i^ + s)2 (J^2 + + 2) (i^ + s + 1) 

where j"{s) is the 2nd derivative of 7(5). Note that 

s^{s-l){A + sf (j^2 + 3j^ + 2) (j^+s + 1) < 

for s < 1. Define the alternative function 

7''"(s) = 7"(s) X {s\s-l){^ + sf {^^ + 3ii + 2) {Si+s + l)) 
= -2^^ X s- X s'^ -3Si^ X + 3j^2 x 
+ 4.^^ X s - S^s"^ -^s^ + 7^x s'^ + 2^x s- 3s'' + 2s^ + Ss"^ 

- In i^^^ - 2j^3 X s - 6j^2 X s^ + 4J^2 X s - 2s^ + 2s^) 
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Define ^y'" (s) , j"" (s) , (s) , j"" (s) as the 1st, 2nd, 3rd and 4th derivative of 7"(s), respectively. 

7'"(s) = X s + 9j^2 X - 2j?2 X s + X _ 8^ X s + 12s^ - 45^ - 4s 

+ In (- "^g ~ X {2£ + 12£ X s - 4.^2 + 18.^ X - 4.^ X s - 4M + 8s^ - 4s) 

, 2.^=^ X s + 18.^2 X s2 _ 10^2 X s + 36^ X - 18^ X - 8.^ X s + 365^ - 365^ + 8s - 4 

7 {s) = 

, / .^(s-l)\ /12.^2^s-12^2^36^xs2-40^xs + 4.^ + 24s3-24s24s + 4\ 
+ ^"'-^^J [ ^^1 ) 



(S- I)2(i^+S) 



18.^2 X s + 72.^ X s^ - 30.^ X s2 + 36.^ X s + 4.^ + 72s^ - 120s3 + 48s2 - 8s + 4 



+ 



+ In 



(S-1)2(^+S) 

j?(s - 1) 
R + s 

36 j^^ X s^ - 72J?2 X s + 36j^2 ^ g4_^ x s^ _ i68J^ x s^ + 84j^ x s + 48s'^ - 9Qs^ + ASs'^ 

(S- 1)2(J^+S) 

For the next part assume K> 2. The case for = 1 will be handled as a special case at the end 
of the proof. Note that (s — 1)2(^+ s) > 0. Define the two functions 

= (36i^2 x s^ - 72j^2 x s + 36^^ + 84j^ x s^ - 168j^ x s^ + 84J^ x s + 48s'^ - 96s^ + 48s2) 
i?2(s) = 18i^^ x .s^ - 2i^'^ - 26Si^ x s - 2Si^ + 90^^ x - 126R^ x s^ 

+ 18£ X s + 72j? X s^ - 30A x s^ + 36j? x s + 4j^ + 72s^ - 120s2 + 48s2 - 8s + 4 

We have that 

t?i(0) = 36j^2 

Solving ■&i{s) = gives the following three solutions 

s = —i 
Si 

s = 1 

It can therefore be concluded that 'i?i(s) > for < s < 1. Using that In < we get 

that In (-%;^) X t9i(s) < 0. 

Taking the derivative of 'd2is) gives the following equations 

^2{s) = 2{^ + 1) (I44s^ + 135s2 X J? - 180.5^ + IBs xH- 144^^ x s + 48s - 13.^^ + 22.^ - 4) 

7?2(s) = 12(j? + 1) (72j? + 45j? X s - 60.S + Sj?^ - 24j? + 8) 
7?2"(s) = 12(j^ + 1) (144s + 45J^ - 60) 
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For ^ > 2 'd2'{s) > 0. This means that there exists at most one value for s such that '&2{s) = 0. It 
is straight forward to see that 

^^(0) = -26^=^ + 18^2 + _ 8 < 
^'^{1) = 10^^ + 36^2 + 42^ + 16 > 

Putting it together we can conclude that there only exists exactly one value for s such that t?2(s) = 0. 
Again, it is straight forward to see that 

^2(0) = -2^3 - 2^2 ^ M + 4 < 
i?2(l) = -10^^ - 18^2 - 2^ - 4 < 

Together with the fact that 1)2(8) is decreasing when s = we can conclude that i?2(s) < for all 
< s < 1 and therefore 7""'(s) < for aU < s < 1. 
Note that In = 0. 

7^'"(0) = 

Since j""'{s) < for all < s < 1 we can conclude that Y"{s) < for all < s < 1. 

V"(0) = 

Since j""{s) < for all < s < 1 we can conclude that j"'{s) < for all < s < 1. 

7"(0) = 

Since 7"'(s) < for all < s < 1 we can conclude that 7"(s) < for all < s < 1. Which in 
turn means that 7"(s) > for all < s < 1. 7(5) is therefore a convex function. It must be at its 
maximum at its boundaries, that is s = or s = 1. 
Using I'Hopital's rule we can show that 

7(s ^ 1) = 



7(5 0) = In 



({A 



+ 1) 



\A{A + 2)J .^(.^ + 2) 

For .ft = 2 we see that 7(5 0) = In (|) — | < 0. Taking the derivative with respect to A gives 

d / 1 2 

-In ' ' — 



dA \A{A + 2)J j?(j? + 2) j?2(j^+i)(j^ + 2)2 

So the function is monotonically increasing in A. See that both In (^^0^^ and ^^^^_^2) go^s to zero 
as .ft — > 00. Since the function was negative for .ft = 2 it must be negative for all finite values of .ft. 
Finally this implies that j{s) < for all < s < 1 as required and this completes the Lemma for 
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> 2. 

For the rest of the proof ^ = 1 

rnn, ^ _ , (^-^\ (^^^'^ - 12s3 - 84s2 + 12s + 36\ _ +1445^ - GOs^ - 1565^ + 20s + 4 
^ (s)-/n(^— (^_-L)2(^ + l) ) (s-l)2(s + l) 

Take the derivative 



y'""(s) = 
+ 



s - 1\ /48s5 - 48s^ - 96s=^ + QGs^ + 48s - 48 

V (s-l)3(s + l)2 

144s5 - 485^^ - 384s3 + 1288^ + 304s + 48 



(S- l)3(s + l)2 

First we have that -384s3 + 128s2 + 304s > 0, -485^ + 48 > and (s-l)3(s + l)2 < for < s < 1 



which means 144^5-48.^ -384.3 +128.^ +304.+48 < for < ^ < i_ 



Define the function 

48s5 - 48s^ - 96s3 + 96s2 + 48s - 48 . 4 „ ^ 2 . , ,x2 

77(5) = = s^ - s^ - 2s^ + 2s2 + s - 1 = (s - l)^(s + \f 

48 

Finally this implies that i""'{s) < for < s < 1. 
So 7'""(s) is monotonically decreasing. 

= 4 

7'''"(0.9) < 

Let < s'l^" < 1 be the point where 7""'(s'o"") = 0. Therefore s'q"" < 0.9. 

7^'"(0) = 
7"" (0.9) < 

Let < s'll' < 1 be the point where 7'"'(s'o"') = 0. Therefore s[)"' < 0.9. 

7^"(0) = 
7'" (0.9) < 

Let < s'll < 1 be the point where 7'"(s^") = 0. Therefore sjj" < 0.9. 

7"(0) = 
7" (0.9) < 
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Let < Sg < 1 be the point where 7"(s'q) = 0. Therefore Sq < 0.9. 

So this means that 7"(s) is positive until some point s = Sq from where it is negative and decreasing. 
This in turn means 7"(s) must be negative until some point s = Sq from where on it is positive for 
s < 1. In particular it has exactly one point in which it is zero. Using I'Hopital's rule we get that 

y(s ^ 0) = 



Which means 7'(s) must start out negative by decreasing from zero. At the point s = Sq it will 
start increasing. Using 

y(0.9) > 



we can hence conclude that 7(5) is first decreasing and then at some point start increasing. The 
maximum of 7(5) can therefor be found at its boundaries. By the discussion earlier we can finally 
conclude that this implies that 7(5) < for all < s < 1 as required and this completes the Lemma 
for ah > 1. 

□ 

4 Entropic Uncertainty Relations for MUBs in prime power dimensions 

In the previous section an improved relation between the collision probability and the Shanon en- 



tropy of a set of probability distributions was established. Given the discussion in section 1.1 the 



connection to entropic uncertainty relations is straight-forward. Here the new relation for prime 
power dimensions will be derived. 



Theorem 1. Let Ai,...,Am be M < d + 1 mutually unbiased observables for a d dimensional 
quantum system, where d is a prime power. Then 



where 



M 



H{Ai) > <PH{k^in) + (M - 1 - <P)H{k 
d + M-1 



i=l 



+ H 



d+M-l 



M X k„ 



(M - 1 - <P)kr, 



^mm '^max 



1 



kn 



Mxd 
d+M-1 

1 



Mxd 
d+M-1 



and H is defined by equation (14)- 



(30) 
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Proof. This follows directly from Corollary [T] and Lemma [8j 



□ 



In order to visualize the difference between ([T]) and (30) it is advised to look at Figure [2] It compares 
the relation between collision probability and Shannon entropy (see eg. jHTOlj ) on which the two 
relations depend. 



25 



References 



Aza04. Adam Azarchs. Entropic uncertainty relations for incomplete sets of mutually unbiased observables. |http : | 

//arxiv . org/abs/quant-ph/0412083 , 2004. 
Ben06. Ingemar Bengtsson. Three ways to look at mutually unbiased bases. ArXiv, 2006. 

BH07. Paul Butterley and William Hall. Numerical evidence for the maximum number of mutually unbiased 
bases in dimension six. Physics Letters A, 369(l-2):5-8, September 2007. 

Boy08. Stephen Boyd. Convex optimization i. Video Lectures, 2008. http: //www. Stanford. edu/class/ee 364a/| 

DFR"'"06. Ivan B. Damgard, Serge Fehr, Renato Renner, Louis Salvail, and Christian Schaffner. A tight high-order 
entropic uncertainty relation with applications, http://arxiv.org/abs/quaiit-ph/0612014, 2006. 

DFSS07. Ivan B. Damgard, Serge Fehr, Louis Salvail, and Christian Schaffner. Secure identification and QKD in 
the bounded-quantum-storage model. In Advances in Cryptology — CRYPTO '07, volume 4622 of Lecture 
Notes in Computer Science, pages 342-359. Springer, 2007. 

Eng03. B.-G. Englert. Mutually unbiased bases. Open Problems in Quantum Information Theory, 2003. |http : | 
'//www. imaph. tu-bs . de/ qi/problems 

HTOl. Peter Harremos and Flcmming Topse. Inequalities between entropy and index of coincidence derived from 
information diagrams. IEEE Transactions on Information Theory, 47:2944-2960, 2001. 

Lar90. Ulf Larsen. Superspace geometry: the exact uncertainty relationship between complementary aspects. 
Journal of Physics A: Mathematical and General, 23(7):1041-1061, April 1990. 

MU88. Hans Maassen and Jos B. M. UfHnk. Generalized entropic uncertainty relations. Physical Review Letters, 
60(12):1103-1106, March 1988. 

San94. Jorge Sanchez-Ruiz. States of minimal joint uncertainty for complementary observables in three- 
dimensional hilbert space. J. Physics A, 27:L843-L846, 1994. 

San95. Jorge Sanchez-Ruiz. Improved bounds in the entropic uncertainty and certainty relations for complemen- 
tary observables. Physics Letters A, 201(2-3):125-131, May 1995. 

WYM09. Shengjun Wu, Sixia Yu, and Klaus Mlmer. Entropic uncertainty relation for mutually unbiased bases. 
Physical Review A, 79:022104, 2009. 



26 



